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Abstract. Understanding under what conditions populations, whether they be plants, animals, 
or viral particles, persist is an issue of theoretical and practical importance in population biology. 
Both biotic interactions and environmental fluctuations are key factors that can facilitate or 
disrupt persistence. One approach to examining the interplay between these deterministic and 
stochastic forces is the construction and analysis of stochastic difference equations X t +i — 
F(X t ,£t+i) where X t S R fc represents the state of the populations and £i,£2,--- is a sequence 
of random variables representing environmental stochasticity. In the analysis of these stochastic 
models, many theoretical population biologists are interested in whether the models are bounded 
and persistent. Here, boundedness asserts that asymptotically X t tends to remain in compact 
sets. In contrast, persistence requires that X t tends to be "repelled" by some "extinction set" 
So C R fc . Here, results on both of these proprieties are reviewed for single species, multiple 
species, and structured population models. The results are illustrated with applications to 
stochastic versions of the Hassell and Ricker single species models, Ricker, Beverton-Holt, lottery 
models of competition, and lottery models of rock-paper-scissor games. A variety of conjectures 
and suggestions for future research are presented. 

To appear in the Journal of Difference Equations and Applications 

1. Introduction 

One of the most fundamental equations in population biology is "what are the necessary 
conditions to ensure the long-term persistence of a population or a collection of interacting pop- 
ulations?" A fruitful approach to addressing this question has been the development and analysis 
of mathematical models. For deterministic models, such as difference or differential equations, 
any reasonable definition of persistence requires th e existence of an attractor bounded away 



2006 . When this attractor is 



from extinction of one or more of the populations |Schreiber . 

a global attractor (i.e. it s basin includes all non-extinct i on states), the system is uniformly 



persistent or permanent Schuster et al. . 19791 Hofbauer . 1981 . Butler et al. . 19861. Perma- 
nence ensures po pulations recover from infrequent large pertu rbations often experienced by bi- 



nence ensures po pulations recover irom intra 
ological systems |jansen and Sigmundl . 19981 



Schreiber. 2006 . Since its introduction, methods 



for verifying permanence have been developed extensively for deterministic models accounting 
for nonlinear species i nteractions, stage-structure within populations, and spatial heterogeneity 
see, e.g, the books of Hofbauer and Sigmundl |l998 |. Cantrell and Cosner 2003 ]. Zhao 2003 1. 
Smith and Thiemd 2011| ). 



Temporal fluctuations in environmental conditions also play a crucial role in determining 
persistence. One approach to understanding the influence of these temporal fluctuatio ns is the 
study of uniform persi s tence for non-autonomou s diffe rence or differential equations |Thieme . 



2000 . Mierczyski et al. . 20041 Smith and Thiemel . 2011]. A strength of this approach is that it 



allows for relatively arbitrary forms of temporal fluctuations including periodic, quasi-periodic 
and stochastic motions. However, the definition of persistence in these studies often requires that 
the population trajectories remain uniformly bounded away from the extinction state. For many 
stochastic models where the vagaries of the environment a r e encapsulated in randomly varying 
parameters, this requirement is too strong (Gillespie . 1973 . Chesson and Warner . 1981 . Turelli . 
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Chesson . 1994 , Ellner and SasakH . 1996 . Bjornstad and Grenfelll . l200ll . lKuang and Chessonl . 



20091 ] . For these models, population trajectories often drift arbitrarily close to the extinc- 

27 tion set. However, under certain conditions, t here may be a probabilistic tendency to stay away 

28 from this extinction set |Chessonl . 19781 . 1982 



29 Here, I provide a partial review of the latter approach to persistence in fluctuating environ- 

30 ments. The main class of stochastic difference equations under consideration are introduced in 

31 Section 2. Definitions of boundedness and persistence are given for stochastic difference equa- 

32 tions. For the former, a rather general theorem is presented. For the latter, results are more 

33 dependent on model structure. Consequently, Sections 3, 4, and 5 discuss results for scalar mod- 

34 els, multispecies models, and structured single species models, respectively. Section 6 concludes 

35 with parting comments and suggestions for future research. 

36 2. Background 

37 To study population dynamics in a random environment, consider stochastic difference equa- 

38 tions of the form 

(1) X t+1 =F(X t ^ t+1 ) 

39 where X t G S represents the "state" of the population at time t (e.g. a vector of densities or 

40 frequencies) and £t is a random variable that determines the "environmental conditions" at time 

41 t. Throughout this article, I make the following standing assumptions. 

42 Al: {£,t}uLo is a sequence of i.i.d random variables taking values in a separable metric space 

43 (such as R n ). 

44 A2: F : S x Q — )• S is a continuous function where S is a closed subset of R fc . 

45 A3: There is a closed subset So C S such that So and S \ So are invariant i.e. F(x, u) G So 

46 if and only if x G So and F(x, cu) G S \ So if and only if x G S \ So- 

47 Assumptions A1-A2 imply that {X t }^ is a Markov chain on S and that {X t }^Z is Feller, 

48 meaning x h-> E[/i(Xi)|Xq = x] is bounded and continuous whenever h : S — > R is bounded and 

49 continuous. For the many of the results presented here, S is either the non-negative orthant R^ 

50 of R fe in which case x G S is a vector of population densities or S is the probability simplex 

51 A = {x G R+ : J2i x i = 1} in which case x G S is a vector of population frequencies. S in 

52 assumption A3 is interpreted as the "extinction set" where one or more populations have gone 

53 extinct. The invariance of So implies that once the population has gone extinct it remains extinct 

54 i.e. the "no cats, no kittens" principle in population biology. Alternatively, the invariance of 

55 S \ So implies that populations can not go extinct in one time step but only asymptotically, an 

56 assumption met by most of the models in the population models in the literature. In particular, 

57 these models do not account for demographic stochasticity which stems from the finiteness of 

58 populations. 

59 It is natural to study the asymptotic behavior of (JT|) from two perspectives. First, one 

60 might ask "what is the probability the populations are in a particular configuration far into 

61 the future?" More precisely, given a Borel set BcS, what can we say about ¥[X t G B] (i..e. 

62 the probability X t G B) for large £? Since these probabilities correspond to the frequency of 

63 observing a particular event across many realizations of the stochastic process, answering this 

64 question provides an "ensemble view" of the long-term dynamics. An alternative perspective 

65 corresponds to asking "how frequently does the typical population trajectory visit a particular 

66 configuration far into the future?" To answer this question, it useful to introduce the empirical 

67 measures for the Markov chain X t given by 

1 l ~ l 



PERSISTENCE FOR STOCHASTIC DIFFERENCE EQUATIONS: 



A MINI-REVIEW 



3 



68 where 8 X denotes a Dirac measure at the point x i.e. S X (A) — 1 if x G A and otherwise. For 

69 any Borel set A C S, lit (A) is the fraction of time that X s spends in A for 1 < s < t. Provided 

70 the limit exists, the long-term frequency that X enters A is given by lim^oo Ht(A). Under- 

71 standing this asymptotic behavior with probability one corresponds to the "typical trajectory" 

72 perspective. 

73 This review focuses on two aspects of the asymptotic behavior: boundedness in which the 

74 populations tend to stay bounded and persistence in which the populations tend to stay away 

75 from the extinction set So- Both aspects are viewed from the "ensemble" and "typical trajectory" 

76 perspectives. 

77 2.1. Boundedness. When studying models of population dynamics, the first question that 

78 comes to mind is "are the long term population abundances bounded?" After all, we live in a 

79 finite world so population numbers can not become arbitrary large for indefinitely long periods 
so of time. For deterministic models, an appropriate notion of boundedness is dissipativeness: the 

81 existence of a compact set C C S such that all solutions of (PQ) eventually enter and remain 

82 in C for all future time. While trivially met when S is compact, this notion of boundedness 

83 is, in general, too strong for stochastic models with non-compact S. For example, theoretical 

84 population biologists often use models of the form X t+ \ = £ t +iXtf(X t ) where / is a positive 

85 function representing the survivorship and £t is a log-normally distributed random variable 

86 representing the mean number of offspring produced by an individual at time t. Since log-normal 

87 random variables are absolutely continuous on (0, oo), X t can become arbitrarily large with 

88 positive probability at any time step. While one might argue that this behavior is biologically 

89 unrealistic, models of this variety have provided many important biological insights and therefore 

90 deserve a careful mathematical treatment. 

91 One less restrictive noti on of boundedness is that the probability X t gets arbitrarily large 



92 becomes vanishingly small |Meyn and Tweedid . 12009 



93 Definition 1. The Markov chain ([T]) is bounded in probability if for all e > there exists a 

94 compact set CcS such that 

(2) liminf ¥[X t G C\X = x] > 1 - e 

t— >oc 

95 for all x G S. 

96 This definition of boundedness implies that across many realizations of the dynamics of (JTJ), 

97 there is a small probability that populations lie outside a compact set far in the long term. The 

98 standard definition of bounded in probability allows for the compact sets C to depend on x as 

99 well as e. However, for most applications, it is more natural to require this stronger definition 

100 which ensures tendency for remaining bounded is independent of initial conditions. 

101 Alternatively, the empirical measure point of view insists that the fraction of time the popu- 

102 lations spend at arbitrarily high densities becomes vanishingly small. 

103 Definition 2. The Markov chain §Q is almost surely bounded on average if for all e > there 

104 exists a compact set CcS such that 

(3) liminf II t [C] > 1 — e almost surely 

t— >oo 

105 whenever X = x G S. 

106 The average in this definition refers to the temporal average in the definition of the empirical 

107 measures U t . T his terminology follows from a weaker notion of boundedness used in the Markov 



108 chain literature [Meyn and Tweedid . 12009 
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109 Definition 3. The Markov chain ([I]) is bounded in probability on average if for e > there 
no exists a compact set CcS such that 

1 <_1 

(4) lim inf - > F[X t G C\X = x\ > 1 - e 



t— >oo t 

i=0 



in for all x G S. 



112 Both boundedness in probability and almost surely bounded on average imply bounded in proba- 

113 bility on average. However, boundedness in probability need not imply almost sure boundedness 

114 on average, and vice-versa. Since we can not expect, in general as discussed earlier, that X t 
us asymptotically remains in a compact set with probability one, I will refer to almost surely 

116 bounded on average as simply almost surely bounded. 

117 As in the case of deterministic models, a practical method for verifying both forms of bound- 

118 edness is finding an appropriate Lyapunov-type function. Recall a that function V : S — > R + is 

119 called proper if firniu.ii_j.oo V(x) = +oo. The following theorem shows that boundedness follows 

120 if there is a proper function V decreasing, on average, along population trajectories whenever 

121 population densities are high. 

122 Theorem 2.1. Let V : S — > R + be a continuous, proper function. If there exist Borel functions 

123 a, (3 : Q — > R + such that 

(5) V(F{x, to)) < a(u)V{x) + 0{uj) for all to, x, 

124 E[loga(£t)] < ; E[log + a(£ t )] < oo ; and E[log + < oo where \og + (z) = max{log(z), 0} 7 

125 then ([1]) is bounded in probability and almost surely bounded. 

126 Remark 1. An alternative proof, to the on e given below, for the case of almost sure boundedness 

127 was given by Benai'm and Schreiber ; 200& . Proposition 4]- 

128 Proof. Define 

Y t = V{X t ), a t = and (5 t = 

129 Define Z t iteratively by Z = Y and 

Zt+i — &t+iZt + fit+i 

130 Theorem 2.1 in Diaconis and Freedmanl . 1999l | implies there exists a non- negative random vari- 

131 able Z such that Z t converges in probability to Z and the empirical measures | Yl s =i ^z s converge 

132 almost surely to the distribution of Z. 

133 Equation ([5]) and the definition of Z t implies that Z t > Y t > for all t. Given e > 0, choose 

134 a > such that F[Z G [0, a]] > 1 — e/2. Since Z t converges in probability to Z, there exists 

135 T > such that 

F[X t G V-\[0, a])} = F[Y t G [0, a}} > F[Z t G [0, o]] > 1 - e 

136 for all t > T. Since V is proper, \^ _1 ([0, a]) is compact. Therefore, X t is bounded in probability. 

137 Similarly, with probability one, 



1 - 

liminf n t (y _1 ([0,a])) = liminf - > 5 Ys ([0, a\) 

t— i-OO t— >00 t J 

S = l 

1 * 

liminf - V S Zs ([0, a]) = F[Z G [0, a]] > 1 - e/2 



> 

t— s-oo t 

s=l 

138 Therefore X t is almost surely bounded. □ 
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139 Boundedness in probability on average combined with the Feller property ensures the existence 

140 of an invariant probability measure: a Borel probability measure fi on S such that if X is 

141 distributed according to \x (i.e. P[Xo G A] = fi(A) for all Borel sets A C S), then it is 

142 distributed according to [i for all time i.e. P[X n G A] = fi{A) for all B orel A C S. The proof of 

143 the following proposition follows from a standard argument, see e.g. Duflo 19971 Proposition 



157 



144 6.1.8]. One can think of it as the stochastic analog of the fact that the o;-limit set for a point is 

145 non-empty for dissipative maps. 

146 Proposition 2.2. If the Markov chain ([TJ is bounded in probability on average, then the set of 

147 weak* limit points of | X^=o^[^s e 'l-^o = x ) w ^ ^ £ S is non-empty and each of these limit 

148 points is an invariant probability measure. Alternatively, if the Markov chain ([TJ is almost surely 

149 bounded, then the set of weak* limit points of U t with X = x G S is almost surely non-empty 

150 and each of these limit points is an invariant probability measure. 

151 2.2. Persistence. When the population dynamics are bounded, population biologists are often 

152 interested understanding the conditions ensuring the long-term persistence of the populations. A 

153 natural analog of uniform persistence for stochastic models is given below. For these definitions, 

154 it useful to introduce the set of the population states within rj > of extinction 

S r/ = {x G S : d(x, So) < fj}. 

155 where d(x, S ) = min ygSo ||x — y\\. 

156 From the "e nsemble" point of view, the following notion of persistence was introduced by 
Chessonl [l982j . 



158 Definition 4. The Markov chain ([TJ is persistent in probability if for all e > there exists 

159 rj > such that 

(6) limsupPfXt G S^|X = x] < e 

t— >oo 

160 for all x G S \ S . 

161 This definition asserts that reaching low densities or frequencies is very unlikely in the long 

162 term. The next definition provides the "typical trajectory" perspective on persistence. 

163 Definition 5. The Markov chain ([TJ is almost surely persistent if for all e > there exists 

164 rj > such that 

(7) limsupn 4 [S^] < e almost surely 

t— >oo 

165 whenever X = x G S \ So- 

166 This definition asserts that the fraction of time a typical population trajectory spends near 

167 extinction states is very small. 

168 When (pQ) is bounded, Proposition 12.21 implies that there exists an invariant probability mea- 

169 sure. If in addition ([TJ is persistent, then the following proposition implies that there ex- 

170 ists a positive invariant probability measure fi i.e. an invariant probability measure satisfying 

171 ^i(S ) = 0. 

172 Proposition 2.3. If the Markov chain ([TJ is persistent in probability and bounded in probability, 

173 then the set of weak* limit points of | X^=o^P^s e 'l^o = x] with x G S \ So is non-empty and 

174 each of these limit points is a positive, invariant measure. Alternatively, if the Markov chain ([TJ 

175 is almost surely persistent and almost surely bounded , then the set of weak* limit points ofU t 

176 with Xo = x G S \ So is almost-surely non-empty and each of these limit points is almost-surely 

177 a positive, invariant measure. 
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178 Proof. Suppose that the Markov chain ([I]) is persistent in probability and bounded in probability. 

179 Let x G S \ So and assume that T 00 is such that j- Y^s=o ^[X s G '|^o = x \ converges in the 

180 weak* topology to //. Proposition 12.21 implies that // is invariant. On the other hand, given any 

181 natural number n, persistence in probability implies there exists t] n > and T > such that 

F[X t G SJX = x] < l/n 

182 for t > T. Hence, by weak* convergence fi(S Vn ) < l/n and //(So) < lim sup^^ //(S^J = 0. 

183 The proof for the case of almost sure persistence and almost sure boundedness is similar. □ 



207 
208 
209 
210 
211 
212 
213 
214 
215 
216 
217 
218 



When a unique positive invariant probability measure exists and the system is persistent, one 
can often show that if X = x G S \ S , then the distribution of X t converges to // and U t 
converges almost surely to // . A powerful tool for veri fying this stronger form of persistence is 
the following theorem due to Meyn and Tweedie [20091 . Chapter 15]. This theorem relies on the 
concept of ip-irreducibility with respect to a Borel set BcS: there exists a Borel measure <p on 
B such that <f{A) > implies that P[X n G A for some n\Xo = x] > for all x G B. 



184 
185 
186 
187 
188 
189 

190 Theorem 2.4. Assume the Markov chain (pQ) is if -irreducible on S\So and there exists a positive 

191 function V : S \ So — > R+, a compact set C C S \ So, and constant (3 > such that 

R\V(Xi)\X = x] < (1 - 0)V{x) + l c (x) for all x G S \ S 

192 where l c is the indicator function for C i.e. lc{ x ) = 1 if x £ C and otherwise. Then there 

193 exists a unique positive invariant probability measure // and the distribution of X t converges 

194 in the weak* topology to //. Moreover, Xl t almost surely converges in the weak* topology to // 

195 whenever X = x G S \ So- 

196 A drawback of requiring <y9-reducibility is that it can be difficult to verify or demonstrably 

197 false for important classes of tractable models. For instance, many important biological insights 

198 have been gleamed from models where there are a finite number of environmental states (i.e. Q 

199 is a finite set). These models rarely satisfy the irreducibility condition and, consequently, may 

200 not have a unique positive invariant measure. 

201 In the next three sections, I review results for persistence of scalar single species models, 

202 multiple species models, and structured species models (e.g. spatial, age, or size structure). 

203 3. Scalar models 



204 The simplest forms of the Markov chain ([Tj 

205 an unstructured, closed population i.e. k — 1. 

206 to 



are the scalar models describing the dynamics of 
S = [0, oo), So = {0}, in which case ([I]) simplifies 



(8) 



X t+1 = f(X t ,£ t+1 )X t with X t G [0,oo) 



where f(x,co) : [0, oo) x Q — > (0, oo) is a continuous function. Random difference equations 
of this form have been studied extensively by many authors Athreva and Dai j_ 2000l. 2002 



l Athreva and Schuhl 120031 iBezandrv et all Eool. iBhattacharva and Maiumdarl. l20o3. iBle et al 



20071. |Chessonl.ll98llEllner!.ll984l.lFagerholm and Hognasl . l2002l . lGvllenberg et al.l . ll994al . lHaske 



nas 



19971 ] . Here, I focus on results that relate to persistence and bound- 



120051 . 1 Vellekoop and Hog" 
edness. 

Reasonably general criterion for extinction, persistence, and population explosion are given by 
the following Theorem. The proof of exti nction and exp l osion fo l lows f rom standard arguments 
that have been used b y many authors [C hesson, 1982, El lnerl . \l98l iFagerholm and H5gnasl . 



1 and Sackerl . 



20021 . iGvllenberg et all Il994j . IVellekoop and Hognasl . Il997| . The argument for boundedness 



follows from Theorem 12.11 and persistence follows from the univariate version of Theorem 1 in 



Schreiber et al.. 2011 
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219 Theorem 3.1. Assume f(x,cu) is a positive decreasing function in x and E[log + /(0, £ t )] < oo. 

220 Then 

221 (i) i/E[log/(0,&)] < 0, then lim^ooXt = for all x > 0, 

222 (ii) if lim^oo E[log f(x, £ t )] > ; then lim^oo X t = oo for all x > 0, and 

223 (iii) if E[log /(0, £)] > and lim a; _ >00 E[log/(x, £t)] < 0, t/ien (JSJ) is bounded in probability, 

224 almost surely bounded, and almost surely persistent . 

225 The assumption that f(x, u) is decreasing with x holds for many "classical" si ngle species mod- 



226 els. H o wever, t h is ass umption doesn't hold for species exhibiting an Allee effect [Courchamp et al. 



1999]. Ellnerl 1984 ] proved results for models where x i-> f(x,u) is not monotonic and 



227 

228 x i — y xf(x,u) is increasing. 

229 Proof. Assume that E[log/(0,£)] < and Xq > 0. Then by the Strong Law of Large Numbers, 

lim sup - log X t = lim sup j ( y ] log f(X s , £, s+1 ) + log X 

t— >oo I t— too « 




< hm - y; log /(o, e s+ i) + io g x ) = E[i og /(o, &)] < o 

t— too t > ' ' 



,s=0 



230 with probability one. Hence, lim^oo X t = with probability one. 

231 Assume that lim a; _ >00 E[log/(a;, £)] > and X > 0. Then by the Strong Law of Large 

232 Numbers, 



lim inf - log X t = lim inf - ( Y] log f(X s , £ a+1 ) + log X 

\s=0 

> lim - I V lim log/(o;,e. + i) + log^o ) = hm Epog /(*,&)] > 

t— >oo I \ ' ' x— too I x— too 

\s=0 / 

233 with probability one. Hence, lim^oo X t = oo with probability one. 

234 Assume that E[log/(0, £)] > and lim^oo E[log/(x, ^)] < 0. To verify boundedness, choose 

235 M > and e > such that E[log/(x, &)] < -e for all x > M. Define V : [0, oo) ->■ [0, oo) to 

236 be the identity function V(x) = x. Define a t = f(M,£ t +i)- Define (3 t = f(0,£ t )M. Since / is 

237 decreasing in M, X t+1 < a t +iX t whenever X t > M. On the other hand, X t+1 < /(0, ^ t+1 )M = 

238 pt+i whenever X t < M. Since E[log + /3 t ] < oo by assumption and E[loga*] < — e by definition, 

239 Theorem 12.11 implies that X t is bounded in probability and al most surely bounded . The proof 

240 of almost surely persistent follows verbatim as in the proof of [Schreiber et al.l . 1201 ll . Theorem 



241 1]. The compactness assumption in this proof is only needed for So which equals {0} for (jSJ). □ 

242 Theorem 13.11 suggests the following conjecture. 

243 Conjecture 1. Under the same assumptions of Theorem 1 3. 1\( Hi). (jHJ) is persistent in probability. 



244 Example 3.2 (The stochastic Hasell model) . To illustrate the utility of Theorem 13.11 consider 



245 



ID 

Hasselll |1975f 's single species model in which to = (A, b) and 

f(x,u) 



(l + x) b 

246 where A is the intrinsic fitness of an individual, and b > determines the strength of intraspecific 

247 competition. For this model, 

E[log f{x, &)] = E[log A t ] - E[h] log(l + x) 



<s 
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249 

250 
251 
252 
253 
254 
255 
256 
257 
258 
259 
260 

261 
262 
263 
264 
265 

266 
267 
268 
269 
270 
271 
272 
273 

274 



275 
276 
277 
278 
279 

280 
281 
282 
283 
284 
285 
286 
287 
288 

289 
290 
291 
292 



Hence, liro^oo E[logf(x, &)] = -oo and E[log/(0,&)] = E[logA t 



Theorem 13. II implies almost 
sure extinction if E[log X t ] < and almost sure persistence if EflogAj > 0.B 

To arrive at stronger conclusions, more assumptions about either the f orm of the no nlinearity 
or the noise are necessary. With respect to the form of the nonlinearity, lEllnerl 1984] . Theorem 
2.2] showed that a monotonicity assumption on xf(x) ensures converge in distribution to a pos- 
itive random variable. In the case of the stochastic Hassell model described in Example 13 .2\ this 
convergence occurs whenever bt G (0, 1] and E[logAt] > 0. 

Theorem 3.3 (Ellner 1984). Assume that F(x,u) = xf(x,u) is continuously differentiable 
and strictly increasing in x, f(x,u) is strictly decreasing in x, and E[log f(x, < oo for some 
x > 0. 7/E[log /(0, > and linx^oo E [log f(x, £ t )] < 0, then there exists a positive invariant 
probability measure \x and the distribution of X t converges in the weak* topology to \i whenever 
X = x > 0. 

The assumption that x t— > F(x, u) is strictly increasing implies F(-, u) is a monotone map for 
each uj. For deterministic systems, this monotonicity pro vides a lot of leverage to understand the 
map dynamics even in higher dimensions, as reviewed in Hirsch and Smith! 2005 ]. This leverage 



has been extended to random maps as reviewed by IChueshovi [20021 ] . In the special cases of 
the stochastic Beverton-Holt model X+ . i = , , Ai+1 „ X f and the stochastic Beverton-Holt model 

1+1 l+a t+1 X t 1 

with survivorship X t+ i = Xt X t + s t+ iX t , a similar result to Theorem 13.31 was proven by 



— i — i L ~i~ at \\ 1 At — - — : — — i 1 

Haskell and Sackerl [20051 ] and iBezandry et al.l 20081 ]. respectively. 



When b t > 1 for the stochastic Hassell model, monotonicity fails (i.e. the map x i— > x f(x,u) 
is unimo dal) and other assumptions a re necessary to ensure convergence to a positive random 
variable. IVellekoop and Hognas Il997j proved an ergodic form of persistence by placing stronger 
assumptions on the random variables Their result is applicable to the Hassell model under 
the assumption that At is constant. The proof uses the Lyapunov function characterization of 
ergodicity described in Theorem 12.41 

Theorem 3.4 (Vellekoop and Hognas 1997). Assume that 

f(x,u)=\g(x)-" 

where g is a positive differentiable function satisfying x h-» xg r (x)/g(x) is strictly increasing on 
[0, oo). Assume that £t are i.i.d. positive random variables with E[£t],E[£f] < oo and a positive 
density on (0, oo). If A > 1, then there exists a positive invariant probability measure \i, the 
distribution of X t converges to fi whenever X Q = x > 0, and the empirical measures U t converge 
almost surely to \x whenever Xo = x > 0. 

Since g(x) = 1 + x satisfies xg'(x)/g(x) — x/(l + x), Theorem 13.41 applies to the stochastic 
Hassell model with X t constant and £t = bt- This theorem is also applicable to the stochastic 
Ricker equation X i+1 = X t exp(r — a t+ iX t ) where r > is the intrinsic per-cap ita growth rate of 
the po pulation and £ t = a t measures the intensity of interspecific competition. iGyllenberg et al. 



1994 J studied the stochastic Ricker model when either r t or a t vary randomly. More recently, 



Fagerholm and Hognasl [20021 ] studied the dynamics of the stochastic Ricker model when both r t 
and at vary randomly. Quite surprising, they prove that if E[r t ] = 0, then (JBJ) is null recurrent: 
there exists no positive invariant probability measure despite W[X t G A infinitely often ] = 1 for 
all Borel sets A with positive Lebesgue measure. 

Theorem 3.5 (Fagerholm & Hognas 2002). Consider the stochastic Ricker model X t+ ± = 
X t exp(r m - a t+l X t ) where 

• r 1; r 2 ,... is a sequence of i.i.d. 
positive density on (— oo,oo), 



random variables such that E[r t ] < oo and r t has a 
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• Oi,a2, ... is a sequence of positive i.i.d. random variables independent of r t such that 
E[a t ] < oo, and 

• there exists x c > such that E[exp(rix)] < oo for all < x < x c . 
Then one of the following statements holds 

extinction: //E[r t ] < 0, then X t converges to with probability one, 
null recurrence: z/E[r t ] = and X > 0, then X t is null recurrent, or 
persistence: if ~E[r t ] > 0, then there exists a positive invariant measure /i such that the 
distribution of X t converges to fi in the weak* topology. 

Fagerholm and Hogna ] |2002| and lGvllenberg et all [l994| also studied the case when a t < 



302 with positive probability. In this case the dynamics have the potential to be explosive (i.e. the 

303 intraspecific interactions enhance growth) and, consequently, the analysis is more subtle. This 

304 case was motivated by numerical studies where r t and l/a t were normally distributed. 



4. Multiple species interactions 

For multiple species interactions in fluctuating environments, one can consider models of the 
form 



k 



(9) Xl+ 1 = f i (X t ,Z t )Xlwithi = l, 

where X\ is the density or frequency of species i at time t. For these models S is a closed 
subset of R/j_ = {x G R fc : > 0} and S = {x G S : Yli x i = 0} corresponds to the 
extinction of one or more species. These models have been used extensively to understand 
under what conditions envir onmental stochasticity and species int e ractions facilita t e or disrupt 



species or genetic d i versity | Chessonl. Il978l. IChesson and Warner!. 1 198 lL IChessonl . Il982l . 11994 



Kuang and Chessonl . [20091 . lAnderies and Beisneil l200l iTurellil . Il978l . Il981 



Despite extensive numerical and theoretical work, there are (to the best of my knowledge) 
only two sets of ma thematical results concern i ng pers i stence for these multispecies models. The 
first set of results Chesson and Ellnei . 1989 . Ellnei. Il989| applies to two species competitive 



systems. The second set of results [Schreiber et al. 



2011Q apply to k species systems provided 
the dynamics satisfy an appropriate compactness assumption. Both of these results utilize the 
average per-capita growth rates of populations when rare. More specifically, define the mean 
per- capita growth rate of species i at population state x to be 

(10) A, (x) = E [log /i (x , £t ) ] ! 

321 and define the mean per-capita growth rate of species % at invariant probability measure fi to be 

Ai(/i) = / Xi(x)fx(dx). 



322 
323 
324 
325 
326 
327 

328 
329 
330 

331 
332 



(11) 

When fj, is ergodic (i.e. J K[h(F(x, £i)] ^(dx) = J h(x)fi(dx) if and only if h is a constant function 
/i- almost surely), \i(fi) is the long-term average of the per-capita growth rate of population i 
when in a system supported by the invariant measure /i. More precisely, since each of the sets 
{xi = 0} is invariant under the dynamics in there exists a set supp(/i) C {1, . . . , k} such 
that for yU-almost all x, x^ > if and only if i G supp(/i). One can interpret supp(yu) as the set 
of populations supported by 

4.1. Competition betwe en t wo species. For competitive interactions between two species, 



Chesson and Ellner 1989 ] and Ellnei 1989j ] proved a "mutual invasibilty" condition implies 
stochastic persistence. In all of their results, they built on the single species results by assuming 

Bl: for each i = 1, 2, there exists a positive invariant measure /ij such that the distribution 
of X\ converges to /ij in the weak* topology whenever X l > and X 3 Q = for j ^ i, and 
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356 
357 
358 
359 
360 



361 



333 B2: the mean per-capita growth rates \i(x) are continuous functions of x G S. Q 

334 The mutual invasibilty condition jTurelfil . 1981 ] asserts that the species coexist provided that 

335 Ai(/i2) > and \ 2 (fii) > 0. Intuitively, whenever one species, say species 2, is rare, the dy- 

336 namics of the other species approaches its invariant measure At this invariant measure, the 

337 per-capita growth rate of species 2 is positive (i.e. > 0) and, consequently, increases 

338 in abundance. Since each species increases in abundance w hen rare, they coexi s t. Un der the 

339 assumption that the competitive dynamics are monotonic, Chesson and Ellner |l989 ] proved 

340 that mutual invasibilty implies stochastic persistence in probability. 

341 

Assume the Markov chain ( 



with k = 2 satisfy 
^((0, x 2 ), £t) hold with probability one only 



342 Theorem 4.1 (Chesson and Ellner 1989) 

343 B1-B2, and 

344 • the equations Xi = Fx((xi, 0), £ t ) and x 2 

345 for x\ = and x 2 = 0, respectively, and 

346 • the functions Fi(x,u) are non- decreasing in x± and x 2 , and positive whenever Xi > 0. 

347 Then Xi(fi 2 ) > and X 2 (^i) > implies ([HD is persistent in probability. 

348 
349 



It is natural to make the following conjecture. This conjecture follows from Theorem 15.21 
whenever the dynamics of (Q asymptotically enter a compact set. 



350 Conjecture 2. Under the conditions of Theorem^. 1\ is almost surely persistent 



351 Under a stronger assumption about the noise terms £t in Theorem I4.1[ lEllner Il989| proved 

352 that there exists a unique positive invariant measure [i such that the distribution of X t converges 

353 to n whenever X\ > and Xq > 0. 



354 Example 4.2. 1 Chesson and Elhierl 19891 ] illustrated the applicability of Theorem 14. II with the 

355 following competition model 



x t+i 



X, 



t+i 



i + n +l xi + e t+1 x? 
i + e w xi + $ +1 xi 



+ aXi 



+ aXf 



where Q > represents the per-capita fecundity of species i and < a < 1 represents the fraction 
of individuals surviving to the next time step. are assumed to have an exchangeable joint 

distribution (i.e. P[(#,£?) G A] = P[(& 2 ,#) G A] for any Borel set A C R+.). If E[log(# + 



a)] > 0, then Theorem 13.31 implies that Bl is satisfied. 
Ai(a*2) = ^2(^1)- Following IChessoii [l988l |. define 



By the exchangeable assumption, 



log 



1 + 0J 2 X 2 



+ a 



Chesson Il988| proved that 



Ai(/x 2 



2 



e td 2 



362 Since 



< 0, it follows that Ai(// 2 ) = A 2 (/ii) > 0. ■ 



duj\du 2 



^This assumption is made in Ellner 1989] and is met for most models. A slighter weaker assumption is made 
in Chesson and Ellner 1989j . 
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363 The monotonicity assumption of F is too strong to cover all models of competitive interac- 

364 tions. For instance, Theorem 14. II does not ap ply to stochastic Ricker models of competition (see 

365 Example 14.41 below). However, lElfnerl 1989| proved that under a stronger assumption on the 

366 noise terms £ 4 , it is possible to show stochastic persistence for such models. The theory presented 

367 in the next section provides a similar approach to verifying persistence for these models. 

368 Theorem 4.3 (Ellner 1989). Assume B1-B2 and 

369 • ([9]) is (p irreducible on (0, oo) x (0,oo), 

370 • (Q is strongly continuous, i.e. for any measurable A C R+ ; P[Xi G A\Xq = x n ] con- 

371 verges to P[Xi G A\X = x] whenever x n — > x, and 

372 • for any x G Ri, sup t>0 E[log + X l t \X Q = x] < oo for i = 1,2. 

373 If Xi(fj,2) > and A2(/xi) > 0, then there exists a unique positive invariant measure fi and the 

374 distribution of X t converges to fi in the weak* topology whenever Xq > and Xq > 0. 

375 Example 4.4 (Ricker equations of competition). To illustrate the applicability of Theorem 14.31 

376 consider a stochastic version of the Ricker equations of competition: 

(12) Xi +1 = XieMH + i-Xl-a 3 Xl) i.j 1.2://./ 

377 where otj > are inter-specific competition coefficients and Q +l are normally distributed intrinsic 

378 rates of growth with means r«. Since exp(^) are log- normally distributed, they have a positive 

379 density on (0, oo). Theorem 13 . 51 implies that Bl holds whenever > for i = 1,2. In particular, 

380 both species are persistent in isolation under this assumption. 

381 The positive density of , on (0, oo) x (0, oo) implies that (1T2]) is ^-irreducible on (0, oo) x 

382 (0, oo) with respect to Lebesgue measure. The strong-continuity condition is easily verified. The 

383 boundedness condition follows from Theorem 12.11 with V(x) — x\ + X2- Let ^ with i — 1,2 

384 be the invariant probability measures in assumption Bl. Theorem 13.31 implies persistence in 

385 probability for the competing species whenever 

\i(fJ>j) = Ti — ajE\X 3 ] > for i = 1, 2 and j ^ i 

386 where X- 7 is random variable with law /jj. By invariance of jij, 

EflogX- 5 '] = ¥\\ogX{\Xl = X j ] = E[log(Xf! exp(^' - X j ))} = E[\ogX j ] + rj - E[X j \. 

387 Hence, E[X J ] = rj and coexistence occurs if 

rj > ajrj for i = 1, 2 and j ^ i. 

388 Thus, the conditions for coexistence are the same for this stochastic version of the Ricker equa- 

389 tions of competition and their deterministic counterpart. ■ 



390 4.2. General multispecies. Recently, ISchreiber et al.l [201 1| extended the results of Chesson 

391 and Ellner to an arbitrary number of species by develop i ng stochastic analogs of the c l assica l 

392 permanence criteria for deterministic systems Hofbauer . 1981 . Hofbauer and Sigmund . 1998 . 

393 These results are based on the following assumptions about Q). 

394 CI: There exists a compact set S of = {x G R fc : Xi > 0} such that X t G S for all 

395 t > 0. 

396 C2: fi(x,u) are strictly positive functions, continuous in x and measurable in u. 

397 C3: For all i, sup x . eS E[(log fc(x, &)) 2 ] < oo. 

398 Assumption CI requires that the populations remain bounded for all time. Assumption C2 

399 implies that {X t }^ is Felle r. Assumption C3 is a technical assumption met by many models. 

400 Under these assumptions, Schreiber et al.l [201 1| proved that if every invariant measure sup- 

401 ported by So can be invaded by some species, then the system is persistent. 
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402 Theorem 4.5 (Schreiber, Benaim and Atchade 2011). Assume C1-C3 and one of the following 

403 equivalent conditions hold: 

404 (i) For all invariant probability measures // supported on Sq, 

A*(//) := maxAj(/i) > ; or 

i 

405 (ii) There exists a positive vector p = (pi, . . . ,pk) > such that 
(13) J>A(//)>0 

i 

406 for all ergodic probability measures // supported by Sq. 

407 Then the Markov chain (Q is almost surely persistent. 

408 While this theorem, as shown below, applies to many models, it has several limitations. First, 

409 it doesn't provide a statement about persistence in probability. None the less, it is natural to 

410 make the following conjecture. 



4ii Conjecture 3. Under the assumptions of Theorem 4-5, (GO) is persistent in probability 



412 A second limitation of Theorem 14.51 is that it requires dynamics asymptotically confined to a 

413 compact set. While this limitation as discussed earlier might be biologically realistic, it would 

414 be useful to have a result that applies to stochastically bounded systems. In particular, one 

415 could ask whether the following conjecture (or an appropriate modification of it) is true. 

416 Conjecture 4. Assume (Q is bounded in probability (respectively, almost surely), C1-C3 hold, 

417 and A*(//) > for all invariant measures \x supported by Sq. Then (Q is persistent in probability 

418 (respectively, almost surely). 

419 Theorem 14.51 does not ensure that there is a unique positive stationary distribution. For this 

420 stronger conclusion, there has to be sufficient noise in the system to ensure after enough time 

421 any positive population state can move close to any other positive population state. 

422 Theorem 4.6 (Schreiber, Benaim and Atchade 2011). Assume that {X t } is ip -irreducible over 

423 S \ for all 7] > 0, and that the assumption of Theorem \4-5\ holds. Then there exists a unique 

424 invariant probability measure // such that //(So) = and the occupation measures IT converge 

425 almost surely to // as t — > oo, whenever X = x G S \ So- 

426 Note that <£>-irreducibility condition do es not require that th e same ip is used for all rj > 0. 



427 Under a stronger irreducibility condition, ISchreiber et al.l |201lj proves that the distribution of 

428 X t converges to // whenever X G S \ Sq. 



429 Example 4.7 (Coexistence of many competitors). To illustrate the applic ability of Theorem [ 476 



430 to hig her-dimensional models of competition, consider the lottery model of iChesson and Warner 

431 119811. This model describes species requiring a territory or "home" (an area held to the ex- 

432 elusion of others) in order to reproduce. Moreover, space is always in short supply and, conse- 

433 quently, all patches are occupied. Let X\ denote the fraction of space occupied by species % at 

434 time t, Q the fecundity of species % at time t, and d the fraction of individuals dying each time 

435 step. Under these assumptions, the lottery model is given by 

(14) x; +1 = (i - d)xi + d -^± i = i,...,k. 

436 Here S is the probability simplex {x G : J^Xj = 1}- Let logQ be normally distributed 

437 with means bi > and variances of > 0. Furthermore, assume that . . . are independent. 
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438 Since log-normal distributions have a positive density on (0,oo), {X t } is yj-irreducible on S v 

439 with respect to Lebesgue measure for all r\ > 0. 

440 If bi > ■ ■ ■ > bk take on distinct values and there is no environmental noise (i.e. G{ = 0), 

441 then species 1 excludes all the remaining species, i.e. lim^oc X\ = for i = 2, . . . , k whenever 

442 Xq > 0. To show how environmental stochasticity can alter this ecological outcome, consider 

443 the case that b± = ■ ■ ■ = bf. and <Ji > for all i. Let [i be any invariant probability measure on 

444 S . Choose a species i such that /i({x G S : Xj > iff j = i}) < 1. By Taylor's theorem, 



452 



= -d + d E 



(15) 

445 Independence and Jensen's inequality imply 

3 



(16) 



E 



jj(dx) > E[f 



H(dx) + 0(d 2 



-u{dx) 



bk- Combining equations 



446 where the final equality follows from the assumption that b\ = ■ ■ 

447 (JT5"]) and ([16]) imply that 

Xi(fi) > 

448 provided that d > is sufficiently small. By compactness of the invariant probability measures 

449 on S , it follows that A*(/x) > for all invariant probability measures supported by S whenever 

450 d > is sufficiently small. Hence, Theorem 14.61 implies there is a unique positive stationary 

451 measure and (114j) is almost surely persistent. By continuity, these conclusions still apply when- 

bj\ is sufficiently small. Therefore, environmental stochasticity can mediate 



ever maxj j \b{ 



453 coexistence between an arbitrary number of competitors. ■ 

454 Example 4.8 (Rock, paper, scissors). In the basic lottery model described in Example 14. 71 per- 

455 capita reproductive rates are independent of species frequencies. Frequency-dependent feed- 

456 backs, however, can be quite important. To illustrate these feedbacks and to illustrate that 

457 persistence may require more than invasibilty by a missing species, consider a rock-paper-scissor 

458 version of the lottery model. To model this intransitive interaction, we assume that the per- 

459 capita reproductive rates are linear functions of the species frequencies 



t+i, 



^2 &+i X: > 



460 where 



461 



6 




and a t > 0t > It > for all t. The frequency-dependent lottery model becomes 

xib^ t+1 ,x t ) 



(17) 



X, 



t+i 



1 - d)x; + d 



1,2,3. 



462 For any pair of strategies, say 1 and 2, the dominant strategy, 1 in this case, displaces the 

463 subordinate strategy. Indeed, assume Xq = 0. If y t = XljX\ and z t = 

(1 _ d ) Zt + d{ lt+l X l t + t+1 Xf 



t+i x u then 



Vt+x 



(l-d)zt + d(Pt+iXl + a t+1 X 2 t 



yt < yt 



464 is a decreasing sequence that converges to 0. Hence, the only ergodic, invariant probability 

465 measures on A are Dirac measures 5 X supported on x = (1, 0, 0), (0, 1, 0), (0, 0, 1). At these 

466 ergodic measures, the invasion rates are given by 
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478 



486 
487 
488 
489 
490 

491 

492 
493 



494 
495 
496 







Ai(m) 


Aa(M) 






5(1,0,0) 







E[log(l-d + da t /A)] 


E[log 


(l-d+djt/fa)] 


5(0,1,0) 


E[log 


(l-d + d 7t /A)] 





E[log 


(l-d + dat/0t)] 


5(o,o,i) 


E[log 


(1 -d + dat/A)] 


E[tog(l-d + d 7t /A)] 








467 



468 A straightforward algebraic competition reveals that the conditions for persistence are satisfied 

469 if and only if 

(18) E[log{l-d + da t /p t )]+E[log{l-d+dj t /f3 t ))>0 

470 For small d > 0, a Taylor's approximation similar to Example 14.71 yields the following simpler 

471 condition for persistence: 



E 



at 



+ E 



It 



> 2. 



472 for d > sufficiently small. 



473 I conjecture that if the opposite inequality of (ITS]) holds, then persistence does not occur. 

474 More generally, 

475 Conjecture 5. Assume that C1-C3 hold, is if -irreducible over S\S r] for all t] > 0, and 

476 A*(/x) < for all invariant measures \x supported on Sq. Then 



limJlXi 







477 with probability one. 



Benai'm et al.l [2008] proved the continuous-time version of this conjecture for stochastic ODEs 

479 on the probability simplex with a small diffusion term. Without the </>irreducibility assumption, 

480 this conjecture is definitively false. 



5. Structured populations 

Populations often consist of a heterogeneous mixture of i ndividua l s in d ifferent states such 

If the population 



481 
482 

483 as its age, size, physiological condition, or location in space [Caswelll . 12001 

484 consists of k states, then its dynamics on S = R+ can be described by nonlinear, stochastic 

485 



matrix models of the form 



X t+1 = A{X t ^ t+1 )X, 



(Xl, . . . ,Xf) is the vector of population densities across the different states and 



(19) 

where X t 

A(x, u) is a non-negative matrix whose entries represent transition probabilities, survivorship 
likelihoods, and fecundities. Here, the extinction set is So = {0}. 

When population abundances are low, it seems reasonable to approximate the dynamics of 
(fT9]) with the linear equation 

X t+1 = A{0,fa 1 )X t 

in which case, 

Xt = A(p,Z t )...A(Q,Z 1 )Xo. 
Under suitab le co nditions (e.g. A(0, £ f ) are primitive, and E(|ln \\A(0, £i)|||) < oo), the work of 
Ruelle 1979 ] and Arnold et al. 1994| implies that there exists a quantity 7 such that 

(20) lim - In (Xj H h X fc ) = 7 with probability one. 

t— >oo t 



In other words, the total population size X}+- ■ -+X^ grows approximately like (A"q+- • -+Xq )e 7 *. 
The quantity 7 is known as the do minant Luapunov exponent and is a lso known as the stochastic 
growth rate in theoretical ecology |Tuljapurkar . Il990l . ICasweii l200l| . For the linearized model, 
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497 
498 
499 
500 
501 
502 
503 
504 
505 

506 



507 
508 
509 



if 7 > 0, the population grows exponentially and persists. Alternatively, if 7 < 0, the population 
is driven to extinction. 



To contend wit h the nonline arities in structured population models, lHardin et al.l [19881 ] ex- 
tended the work of lEllnerl 1984| to structured populations in serially uncorr elated environments. 
Under a slightly different set of assumptions, Bena'im and Schreiber |2009 ] proved a similar re- 
sult that also addresses convergence of the empirical measures and also applies to asymptotically 
stationary environments. Since these latter assumptions are slightly easier to present, I will fo- 
cus on them. In addition to standing assumptions A1-A3, the following additional assumptions 
are needed. 

Dl: Primitivity: There is a positive integer T such that with probability one 
A(X t , £ t ) . . . A(Xi, £1) has all positive entries 



whenever X± G and t > T. 
D2: Smoothness: The map (x,oj) — > A(x,u 
continuous differentiable for all u G S, x G 



Rk 



is Borel, x h-> A(x, u)x = F(x,cj) is twice 
and 



El 



510 



sup In 

IWI<! 



\F(x,u)\\ + \\D x F(x,u)\\ + \\D 2 x F(x,u)\\) < +00 



D3: Intraspecific competition: The matrix entries Aij(x,uj) satisfy 



511 for all u and x. Moreover, for each i there exists some j and / such that this inequality 

512 is strict for all u and x. 

513 D4: Compensating density dependence: All entries of the derivative of x 1— > A(x, u)x 

514 are non-negative for all uj and x. 

515 Assumption Dl, roughly translated, asserts that after sufficiently many time steps, individuals 

516 in every state contribute to the abundance of individuals in all other states. For constant 

517 environments (i.e. S cons ists of a single envi r onmental state), this assumption corresponds to 

518 a matrix being primitive Horn and Johnson! . Il990l . ICaswelll . 12001 1. Assumption D2 is purely 

519 technical, but is met for most models. It is worth noting that lHardin et al.l 1988| do not require 

520 smoothness. Assumption D3 accounts for competition bet ween the s tages . Assumption D4 

521 ensures that (fT9"|) is a random, monotone dynamical system [Chueshov . 20021 . 

522 When 7 is negative for the linearization, extinction is expected as the following proposition 

523 demonstrates. 

524 Proposition 5.1. L Assume Dl and D3 hold. Then 



limsup — In \\X t \\ <7 



n 



525 with probability one and where 7 is the Lyapunov exponent defined in fT20|) . In particular, if 

526 7 < 0, then 



lim X t = 



527 with probability one. 



528 When 7 is positive for the linearization, stochastic persistence is expected as the following 

529 theorem shows. 
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530 Theorem 5.2. Assume Dl D4 and the assumptions of Theorem \2. 1\ hold (i.e. the system is 

531 bounded). If 7 > ; then there exists an invariant probability measure fi such that /i(S ) = ; 

532 the distribution of X t converges to whenever Xq = x G S\ So- Moreover, with probability one, 

533 Ut converges toward [i whenever Xo = x G S \ So- 

534 The monotonicity a s sump tions D3-D4 are definitely not necessary for persistence (see, e.g., 



535 



539 



Bena'im and Schreiberl [20091 Theorem 2]) . Hence, it is natural to conjecture that 

536 Conjecture 6. Assume D1-D2 hold and the assumptions of Theorem \2. 1\ hold. Ifj > 0, then 

537 f lT9|) is almost surely persistent and persistent in probability. 



538 To illustrate the applicability of Theorem l5.21 we consider an example from lBenai'm and Schreiber 



|2009l 



540 Example 5.3 (Biennial plants). Biennial plants typically flower only in the second year of 

541 their existence after which they die. However, for many biennial species, individual plants may 

542 exhibit delayed flowering in which they flower i n a later y e ar. D elayed flowering can serve as a 



543 bet-hedging strategy in uncertain environments |Roerdinkl . Il987j provided a detailed analysis of 

544 a density-independent model of delayed flowering. Here, I describe a density- dependent version 

545 of his model. Let X\ denote the abundance of one year old individuals in year t and X? denote 

546 the abundance of individuals greater than one year old in year t. Let p be the probability that 

547 a plant flowers during its second year. Let £ t +iSi(X t ) be the mean number of germinating seeds 

548 produced by a flowering plant in year t where s 1 (x 1 ,x 2 ) = 1+bl ^ 1+X2 y Let s 2 (x 1 ,x 2 ) = 1+fc2( ° 1+3 . 2) 

549 be the probability that a plant survives to the next year. Then the plant dynamics are given by 

(21) Xt+1 -{s 2 (X t ) (l-p)s 2 (X t )) Xt 

550 Let £1,^2, • • • be a sequence of independent random variables that are Gamma distributed i.e. 

551 having the probability density function 

552 where the scale parameter is 6 > 0, the shape par ameter is k > a nd T(k) = J °° t k ~ 1 e~ t dt. The 

553 mean and variance of £1 are given by k9 and k9 2 . Roerdink 1987l | found an explicit formula for 



554 the dominant Lyapunov exponent. For < p < 1, the dominant Lyapunov exponent is given by 

POD 

7 = lna(l -p) + K- 1 / ln(l + 1) + ty k e~ zt dt 

Jo 

555 where K = f^°t k ~ 1 (l + t)~ k e~ zt dt and z = (1 — p) 2 /{0p). For p = 0, 7 = In a, while for 

556 p = 1, 7 = I (\n(a8) +ij;(a)) where ip(a) is the digamma function. Roerdink proved that ^ is 

557 positive at p = and approaches —00 as p approaches 1. Hence, the stochastic growth rate 7 

558 of the population is maximized by the population playing an appropriate bet hedging strategy 

559 for flowering (i.e. p strictly between and 1). Therefore, Theorem 15.21 implies that persistence 

560 is more likely for populations playing a bet hedging strategy. 

561 6. Concluding remarks and future directions 

562 While these results represent the promising beginnings of a general theory for persistence of 

563 stochastic difference equations, there is still much work to be done. The conjectures sprinkled 

564 throughout this review are merely the tip of the iceberg. To give a sense of some other issues, I 

565 discuss three directions for future research. 

566 First and foremost, one can ask "Is there a general theorem unifying all the particular cases of 

567 the persistence results?" For dissipative deterministic models, there are two characterizations of 
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uniform persistence. The average Lyapunov characterization due to lHutsonl 1984j . ll988| requires 
the existence of a non-n egative function that increase s on ave r age fo r tra jectories near the extinc- 
tion set. Alternatively, Butler and Waltmanl |l986j |. Gar ay 1989 1 and Hofbauer and S3 Il989l 



provided topological characterizations of uniform persistence in terms of Morse decompositions 
and stable sets. Intuition suggest s there should be a s tochastic analog of the average Lyapunov 
function characterization. Indeed Bena'im et al. 1 12008| used average Lyapunov functions for the 
deterministic models to prove persistence for the stochastically perturbed models. Whether this 
argument can be extended is an exciting and challenging open prob lem. 



Many environmental signals are positively autocorrelated in time [Vasseur and Yodzisl . 12004 



Understanding the impacts of these autocorrelations for population persistence and species 
inte ractions is a very active area of research in theoret i cal and empirical populat i on biol 
ogy (Heino et al.Ll2000LlGqnzalez and Holtl l2002l lRov et all 120051 ISchwager et all 



20071 . iReuman et all . 120081 iRov and Holtl 120091 . ISchreiberl . l2010l 



2006. Matthews and Gonz 



relations, the environmental sequence of random variables 

independent. However, they may be stationary or even asymptotically stationary i.e 



To account for these autocor- 
£i,£2j •••) can no longer can be 



A), 



. X t+n G 
, A n c fi, 



A n ] - F[X t+s e A 



o- 



X, 



t+.i+n 



e AJ 



n > 1 and s > 0. Bena'im and Schreiber 2009 



as t — > oo for any Borel sets 
Theorem 4] made this exten- 



sion for structured populations models satisfying monotonicity assumptions as in Theorem 15.21 
Similar extensions have yet to be made for multispecies models or non-monotonic structured 
models. 

In order to apply the methods reviewed here, there is a desperate need for general methods 
to estimate the mean per-capita growth rates A;(/z) and the dominant Lyapunov exponent 7. 
One approach is to consider "small noise approximations" of these quantities when distribution 
of £t is close to a Dirac measure. For structured population models where A(0,£t) = A + 
eB t for a fixed no n-negative matrix A and a sequence of random matrices B t with mean 0, 



Tuljapurkarl [1990| developed second and higher order approximations of the dominant Lyapunov 



exponent 7 with respect to e. This approxi mation yielded many useful insights into stochastic 
demography and metapopulation persistence Wiener and Tuliapurkar . 1994 . Bovce et all . 2006 . 
Tuljapurkar and Haridasf . 2006 . Morris et al. . 20081 Tuljapurkar et al. , 2009 . Schreiber . 2010| . 



Alternatively, for models of competing species, Chesson developed methods for estimating A;(/i) 
when the deterministic dynamics converge to an equi librium and th e small noi se generates 
small demographic fluctuations around this equilibrium |Chessonl . Il988l . I1994J . [2000j . Extending 
these methods to arbitrary species interactions and random perturbations from non-equilibrium 
dynamics, however, is an important remaining challenge. 

In conclusion, this review highlights the progress, challenges, and opportunities in using sto- 
chastic difference equations to understand the conditions necessary for population persistence. 
The speed at which this review becomes hopelessly outdated may be the best measurement of 
its success. 
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